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PREFACE 


This report is the first ina series to be published at six- 
month intervals describing the literature of computer-assisted 
instruction (CAI) as it has been compiled by ENTELEK under contract 
Nonr-4757(00). This report covers approximately one hundred docu- 
ments abstracted prior to December 31, 1965. Obviously, the CAI 
literature is more extensive and it is hoped that subsequent reviews 
will be more nearly representative of the whole. , 


The contents of the report are organized according to the key 
word organization of the ENTELEK CAI information exchange. Cita- 
tions given are the serial numbers assigned to documents in the 
ENTELEK system. 


The section of this report dealing with interface equipment was 
written by John M. Newton. Albert E. Hickey is responsible for the 
balance of the report. The authors are indebted to Drs. Glenn Bryan 
and James Regan of the Personnel and Training Branch, Office of 
Naval Research, who have constructively monitored the general develop- 
ment of the system from its inception. 
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I. APPLICATIONS 


A. SUBJECT MATTER 


Appendix A lists 41 references to CAI programs in mathe- 
matics and statistics, histevy, languages, science, economics, 
accounting, engineering, computer technoiogy, reading, games, 
and industrial and military skills. These 41 citations, however, 
describe about 20 distinct programs, few oi which are more than 

ree study-hours in duration. 
— nnn 


Potential application of automated instruction.to other sub- 
jects is also discussed in the literature, For example, inan 
experiment on the discrimination learning of smoothness of machined 
metal surfaces, Mager and Ciark (63-901) demonstrated the possi- 
bility of teaching non-objective responses, including judgements of 
social or nonsocial stimuli, value, and attitudes. 


B. OTHER APPLICATIONS 


Automated instructional systems have also been used for 
purposes other thaninstruction. Pines (65-502) reports that the 
Edison Responsive Environment has demonstrated therapeutic value 
for autistic children. 


The Control Systems Laboratory at the University of Illinois 
has investigated a textbook tester that will »ermit an ordinary text- 
book to be entered into the PLATO system and a complete record 
kept of the student's work studying it (64-1202). Analysis of students’ 
use of the text will indicate necessary text revisions and these can be 
made and tried out immediately. 


Feurzeig (64-804) believes the Socratic System has potential 
value in areas other than teaching, e.g., pianning, testing, inter- 
viewing, and monitoring. Stolurow (64-1101) has reported on an 
adaptive retrieval system for use with abstracts. Retrieval strategies 
adopted by the system are dependent on the user's response to ab- 
stracts. 
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il. SYSTEMS 
A. SYSTEMS ANALYSIS 


Systems analysis refers to the construction of models and 
procedures to optirnaize seme function of tue variables involved in 
the model. The function may be learaing. 


Stolurow (65-702) believes a general cybernetic model of 
an instructional system has seven components: input (display to 
the learner), learner, output (learner response), performance 
standards, comparator (comparison of output with standard), library 
and feedback. He has outlined the variables associated with each 
component. 


SOCRATES is an operational model of the instructional 
process as seen by Stolurow (65-762, 64-901). The model is ideo- 
morphic in that it considers the learner's characteristics as assessed 
before instruction and is also adaptive during instruction. 


Mayer (64-902) views the trainee and instructor as operators 
within an information system and proposes a model for use in the 
application of human engineering principles and techniques to the 
design of instructional systems. . 


Egbert and Cogswell (64-202) examine a plan for a Continuous 
Progress School (CPS) being developed at the Brigham Young Univer- 
sity Laboratory School and use the data for systems analysis and 
simulation to construct an explicit descriptive model of a future CPS. 
In another report (64-303) the same authors outline the use of systems 
analysis and computer simulation in investigating the effects of 
innovations and adjustments in schooi curricula. 


B. COMMON SYSTEM CHARACTERISTICS 
l.. Time-Sharing 
To be economical, large computer-assisted instructional systems . 


must service many students at once. Thus, time-sharing is an import- 
ant requirement. 
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"A computer-based teaching system has a number of student 
stations tied to one central, general purpose, high-speed computer. 
With such a time-sharing system, the decision-making and computa - 
tional power of the central processor can be haxnessed to provide 
for sophisticated automatic teaching techniques (Braunfeld, 62-802).'"' 
Due to the speed of the computer, a given student is seldom conscious 
of the fact that other persons are being serviced by the system. 


Lochner (65-903) describes time-sharing in the Dartmouth 
College system. Equipment consists of a GE-235, a Datanet-30 Com- 
munications Controller, and a dual-access disc file. The D-~30 is the 
master computer and schedules ail nontrivial operations in the 235, 
In addition, the D-30 handles input/output from and to the teletypes, 
allocates and releases disc space, and analyses and responds to user 
commands. Lochner includes ideas on optimizing the use of a time- 
shared system. 


Feurzeig (64-601) sees time-sharing of the computer as the 
way to make the BBN Socratic System, with its extensive vocabulary 
and logic requirements, economicaliy feasible. In other papers 
(64-804, 64-803) he describes the use of time-sharing in the Socratic 
System to evaluate "collaborative time-sharing.'' An experiment was 
run in which six subjects, sitting at separate consoles, worked together 
‘ona problem. They did somewhat better through collaboration than 
each would likely have done individuaily. 


In 1963 the PLATOI system at the University of Illinois 
Coordinated Science Laboratory. was replaced by PLATO II which 
was used to study problems of time-sharing. Now PLATOUII, based 
on a CDC 1604, is capable of controlling 1000 student stations, although = 
20 was set as an initial goal (64-1202). 


in a manual (64-001), IBM explains that, with proper equipment, 
the IBM 1401 or 1440 operating system used for computer-assisted 
instruction may be time-shared so that it can simultaneously teach up 
to five courses, using up to 12 typewriter stations. 


In Russia, the Radon complex at the Academy of Sciences of 
the Ukrane uses the general purpose UMShN computer with up to 25 
student terminals (64-201). Expansion of the time-sharing system 
will allow it to teach 120 to 150 students as many as four different 
subjects simultaneously. 
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An advanced application of time-sharing is planned ina coaxial 
community cable network that will connect 10,000 homes in Columbia 
City, Maryland, toa community digital computer (65-603). The system, 
which will enable the near simultaneous use of the computer by 5000 
people, is being designed by the Brooks Founcation in conjunction with 
the Maryland State Dept. of Education. 


2. Partial Answer Processing 


Preiiminary data collected by Wodtke and his associates 
(65-902) indicate the importance of paxtial answer processing, by which 
the computer in a CAI syster is instructed to ignore trivial errors and 
differences in student-response formats. Student controlled pauses in 
the instructional output of the systerm also seem important. The study 
was conducted at Pennsylvania State University using remote terminals 
of the iBM Yorktown system. The Socratic System also provides for 
partial answer processing through the use ofa subroutine called CODEX. 


C. OPERATIONAL SYSTEMS 


In the past three or four years computer-assisted instruction 
systems have grown, more or iess independertly, in several labora- 
tories. These pioneering examples of CAI share some common features, 
such as time-sharing just described. Each also has unique features. 

In this section we list and describe several well-established systems. 


In the recent past, each of the'followinzg systems was restricted 
to the laboratory or campus on whicn it was generated. Recently, 
however, remote terminals for several of these systems have been 
installed at other laboratories and schools, scmetimes at the opposite 
end of the country and even overseas. Thus, some systems can no 
longer be identified solely with a particular institution, except histori- 
cally or administratively, but are nationwide in extent. 


1. IBM Yorktown. 


An extensive system is based on the IBM Watson Research 
Laboratories at Yorktown, New York. This system was originated with 
an IBM 650 RAMAC with a disc file for 6 million digits and 0.8 secs. 
maximum access time (64-302). I/O ce vability was provided by 20 
Modified Inquiry Stations Type 833. In 1964 aa IBM 1440 was sub- 
stituted for the 650 (65-902, 65-803, 64-001). 
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Students at Pennsylvania State end Florida State Universities 
now take courses transmitted from I3M's Yorktown complex (65-902). 
The course is presented at a modified electric typewriter and by 
random-access slide projector and tape recorder. 


In 1965 the IBM Yorktown system was linked by telephone wire 
to terminals at the Amev'cana Hctel in New York City for the Ameri- 
can Management Association confereace on educational technology. 


2, iBM Poughkeepsie 


A system similar to the IBM Yorktown system is based on an 
IBM 1440 at Poughkeepsie. Through remote terminals located at 
IBM offices in Philadelphia, Los Angeles, San Francisco and Wask- 
ington, D.C., IBM customer engineers will receive training while on 
call at their offices (65-1002, 65-910, 65-803). 


3. University of California at Irvine (UCI) 


Under a joint research agreement with IBM, UCI will become 
‘a computer laboratory for investigating all the ways in which the com- 
puter can aid educational institutions (65-910). 


4. Dartmouth Time-Sharing System_ 


The Dartmouth system is presently more suited to the labora- 
tory type of instruction and handles jobs from 30 remote consoles, 
Equipment consists of a GE-235, a Datanet-30 Communications Con- 
troller, and a dual-access disc file. Vhe D-30 is the master computer 
and schedules all non-trivial cperations in the 235. The D-30 can 
communicate with the 235 or the dual-access file. In addition, the 
D-30 handles 1/O from and to the teletypes, allocates and releases 
disc space and analyzes and responds to user commands. The 235 
is used for editing, compilation, program runs, and large block 
transfers from one area of the disc to another. Incoming problems 
share the 235 in short bursts of time on a rotating basis. 


When the system was first put into operation, only one 
algebraic compiler, BASIC, was available. Subsequent additions have 
included: TEACH, a system which allows an instructor to code BASIC 
programs to analyze the results of a student program while the student's 
program is running; a fairly compiete version of ALGOL 60; a machine- 
language interpretive program called Di»; and a program maintenance 
system calied EDIT. Lochner (65-903) covers the approach used to 
develop the system and response by users. 


} 
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Berkeley (65-904) demonstrates the use of a remote console 
of the Dartmouth system situated in a mathematics classroom at 
Phillips Exeter Academy. The student-contrived programs for 
Tic Tac Toe and Roulette are in BASIC. 


5. CLASS 


Tne Computer-based Lasoratory for szAutomated School System 
(CLASS), developed by the System Development Corporation, pro- 
vides instruction for up to 26 students under <he control of a computer. 
In addition to a laboratory-tyve course in statistical inference, CLASS 
has been used for computer-based stucent counseling and field evalua- 
tion of an elementary Spanish course (65-402, 64-403). 


6. System 473L_ 


System 473L is a command-control system operated by the 
U.S. Air Force. It includes an automated instructional subsystem 
which teaches AF console operators the query language to be used in 
communicating with main system (64-1203). 


7. Edison Responsive Environment 


The Edison Responsive Environment is a jam-proof electric 
typewriter, slide projector, and tave recorder, all connected toa 
self-contained logic network or computer. Currently the logic is not 
time-shared among students, although it may be in the future. The 
system is used pEameviny to teach pre-school children ToD EUARS arts 
(65-502). 


8. SAKI 


The best known of the machines developed in the UK by Gordon 
Pask is SAKI, which instructs the student in keyboard operation 
(65-103). Errors and response times were calculated by SAKI, com- 
pared with standard performance and fed bacx to the student. It was 
not a time-shared system. 


9. COBIS 


The Computer-Based Instructional System (COBIS), located 
at the Electronic System Division, Harscom Air Force Base, Bedford, 
Mass., is based ona DEC PPD-1(65-301). It has three principal 
features: (1) A light pencil is used as the medium of communication 
between the student and the computer. (2) The student indicates his 
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degree of certainty for each zi.oraative ...u muitinle choice array 

by adjusting the bars cf lizgat aews 1o cack, answer ona CR screen, 
(3) The computer consicers voit the student's aaswers and his 
degree of certainty when branching to remediai sequences or further 
steps. A speciai scoring system has been deveioped for this purpose. 


10. The Sceratic Systera 


in the Socratic System, developed by Belz, Beranexk and 
Newman, Inc., around the DEC PDP-1 computer, the teacher and 
tudent carvy on a dialogue in depth (55-1001, 35-703, 65-302, 64-0601, 
4-503). The computer states a sroklem, sets up conditions, asks 
questions, provides requested data, and answe+s questions, while 
observing the student's course of action ina task. The system has 
been applied to instruction in medica: diagnosis and business decision 
making. 


& 
L 
o 


ii. SOCRATES 


SOCRATES is a time-shared system developed at the Training 
Research Laboratory of the University ofIllincis. It is adaptive in 
three ways: (1) it learns about the student as i: teaches him, (2) it 
may make cecisions about the effectiveness of -he rules used to teach 
the student, and (3) it may make decisions about the criteria which 
are used for evaluating performance. 


The first SOCRATES student interface was put on-line in May 
1964. SOCRATES uses an IBM RAMAC externai disc memory of 
2 million-digit capacity to supplement internal storage in an IBM 1620 
computer. The system may display any of 1500 frames of film to the 
student. An iBM 1800 central computer and a Westinghouse sound box 
with 1000 stored one-sec. messages under computer control are on 
the way (65-701, 64-1101, 64-901, 64-602). 


i2. PLATO Iii 


PLATO Ill is. the most recent ina series of systems devised 
by the Coordinated Science Laboratory at the University of Illinois. 
The central computer, a CDC 1604, is connected to 20 student stations. 
The system uses an "electroric book and blackboard" video display | 
system on wnich are superimposec poth opticai and CRT displays. The 
basic logic is tutorial and intrinsic. Tae PLATO compiler (CATO) is 
compatible with FORTRAN. 
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One capability of PLATO is. Responsive Environment Pro- 
grammed waboratory (REPLAB). A riction picture film is first 
shown using auxiliary equipment, then PLATO presents questions. 
Two brief programs have been used, one in vhysics (6th grade) and 
one in clinical methods for student nurses. A mathematics labora- 
tory called PROOF is also in use (64-1001, 64-401, 62-901, 62-8062, 
62-702, 62-401). . 


D. STUDENT INTERFACE EQUIPMENT 


The stucent interface is the junction, or communication link 
between the student and the computer... is aa essential part of 
every CAI system. All systems in the literatare reviewed are based 
upon two-way communication -~- indeed, obtaiaing such an interaction 
or "conversation" between pupil anc computer is a major reason for 
using computers as teaching cevices. 


4 


is Display Techniaues 


The problem is twofold: the computer’s output must be displayed 
to the student and the student's output (responses) must be fed inte the 
computer. A simple way to achieve both functions is to use an electric 
typewriter. This was the technique used in the early work in the IBM 
laboratories (64-302, 59-001), and is an alternative with the present 
IBM "Coursewriter'' system (65-803, 64-001). A typewriter (teletype) 
keyboard is also used for CAI with the Dartmouth Time-Sharing System 
(65-903), and with the Bolt Berarek and Newman "Socratic System" 
(65-1001, 64-601). 


While a typewriter has the advantage cf'being an extremely 
flexible student response devise, its relatively slow speed limits its 
desirability as a display for the stucent. This limitation has been cir- 
cumvented by using a visual display with more rapid access to computer 
storage (e.g. a CRT), by using an auditory display, and by storing 
messages on film or tape and displaying these directly. In the latter 
case, the computer is used only to cetermine the location of the message; 
therefore requirements for storage capacity are greatly reduced. 


In IBM's "in house" research on their CAI system, CRT displays 
are used in an experimental employee training course in two locaticns 
(Washington, D. C. and San Franciecc) using the IBM 1050 input-cutput 
station (65-803). Other training locati:cns are using the typewriter alone. 
‘nis system uses telephone data lines for comraunication with a central 
computer, and has additionai telephones lines for direct voice comraunica- 
<ion with a numan instructor. Tae SOCRATES system at the University 
of Illinois Training Research Laboratory is scheduled to have a CRT 
display in the near future (64-1101), and COB/S at the Air Force's De- 
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PLATO, developed at the Coordinated Science Laboratory, 
University of Illinois, uses a unicue combination of techniques 
(64-702, 64-401). Basicaily a video cisplay, it is described as an i 
"electronic book and blackboard.’ The 'cook" section allows indivi- : 
dual microfilm slides to be displayed on the television screen, while 
the students' answers to questions, etc. are presented on the same 
screen ina manner analogous to writing on a blackboard. i 


_ Inits present configuration, SOCRATES employs a microfilm ' 
display (65-701, 65-101, 64-602). The central computer (an IBM 1620) 
controls a random access microfilm transport which displays one of 
1500 instructional slides to the studert. Microfi:m slides are aiso 
used in the computer controlled economics games developed by the 
Board of Cooperative Educational Services of Northern Westchester 
County, New York (65-203). While the basic display is a typewriter 
(IBM 1050), a random access slide projector provides auxiliary inform- 
ation to the student. 


A quite different display was utilized by Teleregister for United 
Air Lines which makes collateral use of their 'Instamatic" reservation 
system for training ticket agents (64-404). The instructional materials 
are presented in book form as muitiple-choice questions. A regular 
reservation printout card is used to display answers. 


A combination typewriter-voice-slide projector display is used 
in the Edison Responsive Environment or "talking typewriter" (65-502). : 
The typewriter both types and names ietters and words when its keys 
are properly depressed. It also displays slides of letters or words as 
cues to the response of typing them. 


2. Response Techniques 


A typewriter keyboard is the basic response device in the IBM 
Coursewriter system (65-803), the Board of Cooperative Educational 
Services economics games (65-203), the Dartmouth Time-Sharing 
System (65-903), and the Edison Responsive Environment (65-502). 
The PLATO system aiso uses a typewriter (teletype) keyboard, but in 
its various configurations may assign many different purposes to the 
keys (64-702, 62-401). Plastic caps are placed over special purpose 
keys to identify them. 
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wo sys”: use keyboards otaer ther that of a standard type- 
writer. SUCRA. | «a3 fifteen buttons whica may be asigned a variety 

of functions depending on the program -- e.g. .etters, digits, yes-no, 
etc. (65-701, 65-101, 64-602)... The Tcieregister-United Air Lines 
system uses the "Instamatic" agent-set keys with an overlay to reidentify 
them for taining (64-404). 


he student reszonses to CCBIS are wade with a light pencil 
(65-501, 65-301). A bar of light is dissiayed next to each muitiple- 
choice answer ona CRT. These dars sepresent the probability of 
correctness of each answer, and the student indicates his degree of 
certainty for each answer by ac,usting -. ¢ length of the bars with nis 
light pencil. Both the answer and the cegree of certainty are considered 
by the cormputer when brancaing or advancing to the next level. 


Two publications are avai:able which consider general interiace 
problems. The first, by Randa of MIT (62-201), is concerned with 
basic harcware. The second, by Giaver, Ramage and Lipson (65-204), 
deals with more specific instructional problems and considers the choice 
of ecuipment for different subject matter, for special education, and 
for research. 
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CAI languages can be Civided into progyrammer-oriented and 
user-oriented languages. Yhe users in turn fall into two classes: 
teachers and students. Teachz»-ori¢nted ianzuages, suchas 
COURSEWRITER, are the mecium by which tae instructor tells the 
computer what assertions tc make tiche stuaent, especially as & 
function of the studeni‘s previous esd ,onseis). A student language 
is the medium by which the stuceni itceracts with the computer. 
When the student is to use the compiter as « tool or laboratory to 
sOive a problem ora sequence of »:roblems, the student language may 
be a comviler (e.g. BASIC) or a problerm-oriented or simulation 
language (e.g. SEPOL). 


A. STUDENT LANGUAGES 


BASIC. A vrogrammer-oriented aisebraic compiier 
availapie for the Dartrnouth time-sharing system 
(65-903). Has been usea by seconcary school students 
to program games, ''Tic+Tac-Toe" and "Roulette, ' on 
the Dartmouth system (65-904). 


hs 
. 


2. TEACH. A system which allows an instructor to anaiyze 
the results ofa stucent's program while the student's 

rogram iis running. Jsed in the Dartmouth time-sharing 
ystem (65-903). 


3. SIMIN (Simulated Statistical Inference Program). Used 
to teach inferential statistics at Michigan State Univer- 
sity; 66 types of computer outpuc are available to the 
student (64-002). 


4. Natural Language (e.g. English). Most query languages 
take the form of artificial, quasi-English languages which 
bear slight resemblance to ordinary English, but are 


suificiently simple syntactically and sufficiently mnemonic 


lexically that user can master them with less difficulty 
than more specialized languages. Keyser (63-902) and 


Raphael (64-604) outline linguistic theories which increase 


the possibility of tae use of natural English as a query 
lacsguage in CAI systems. 
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5. Graphic Language. Alicsovugh che iceal is generally held i 
to be a natural languazve, e.g. Engitsh, Duggar et al i 
(65-1062, 63-1202) cite the potential advantages of i 

sraphical symbolegy anc .ogic flow ciagrams over i 
“aglish as a language for teaching iogic and decision i 
vasks to students. 


B. PEACE LANGUAGES i 


1. COURSEWRITER. Preserted by 1B es an aic in writing 
sad presenting instructioral materia! through the iBM i 
401 anc i410 computers ane if50 Data Communications 
System. Course presaravion requives no special knowledge 
omputers. COURSEWR:7VER has a dozen basic in- 
tions and its use car ba learned in one or two hours 
G COURSEWRITER has beur used to program 
atistics (64-302) and sevezal other subjects. 


Pa 
0 


2. HENTOR. A teacher-oriented languzge and compiler for 

vne Socratic System in whica language.conventions have 

Seen chosén so as to make the intertion of the control i 
utatements comvrenensib.e'to the teccher as well as the pee! 
srogrammer. ‘hus, the teacher may "converse with the 
cornputer when drawing uo his instructional program in 
caucn the same way that tae student talks with the machine 
curing a lesson (64-804, $4-303)."' i 


3. CATO. The PLATO compiler is compatible with FORTRAN, 
gacilitating its use by non-tecnnical persons who wish tc ; 
sreoare lessons for PLATO (64-1002). i 


Cc. PROBLEM-ORIENTED STUDENT LANGUAGES i 


l. STRESS (STruciural Engineering Froplem Solver). Used 
wy the graduate class in structures ia the MIT Civii 
<ngineering Dept. to design.compiete structures (64-301). i 


2. COGO (COcrdinated CeOmetry). Ancther problem- 
oriented language used at MIT. Includes 70 special words 
including 'yoint,'"' "distance," “Llocate,'' etc. (64-3013. 


3. SEZPOL (Soil Engineering Proolem-O-viented Language). 
Used in MIT Civil Envineering Dep. (64-301). 
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D. COMPILERS 


i. ALGOL 60. A progzammer-oriented compiler available 
on the Dartmouth time-sharing system (65-963). 


2. DIP. A machine-lanvuzge intersvetive program used on the 
Dartmouth time-'harir- system (65-903). 


EDIT. A orogvan. viaintenance'system available on the 


Ley) 


Dartmouth time-sharing system (05-903). 
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iv. INSTR COCTION SS TA eae 


Some of the systems descrised in Chapte: Ii are the resuit of 
the systematic consideration »y behavioral scientists of the facts and 
theories of learning and instruccion. Such systems are "custom- 
made" for instruction. “lis is cav.iezaxiy true of the tutorial systems. 


Other systems, particuiriy tae iasovaiory systems, simply 
represent the application of tne computer es z. problem-solving tovi 


° 


to didactic problem-solving as a technicue of instruction. 


Whether guided by behavior theory or tne seat of their paats, each 
jecision by a system designer cr a pregrammier contributing to the 
design or implementation of a system is a contr-bution to a miniature 
theory of instruction. Tae system diagraris, ilow charts and programs 
of CAI are theory fragments, or 'logi¢s,'' based on some assumptions 
about the iearning process. 


At the same time, data collected in comruter-directed learning 
exercises are being added to the store of information on the instruction 
and learning processes. in some systems, such as SOCRATES, « fair 
amount of time is scheduled for systematic comouter-controlied studies 
of learning and instruction vaviables. In other systems, observations 
on learning effectiveness are inforraai and incidental to application. 


in reviewing the studies of learning and instruction related to 
CAI, we have sevarated the reports into three categories:(1) Experi- 
mental studies of learning, such as the learning of paired asscciates, 
which seem to have a direct application to CAI. (2) Analysis of tae 
instructional logics on which various systems are based. (3) Optimi- 
zation of learning by the design and evaluation of instructional sequences 
(programming). 


A. STUDIES OF LEARNING 


il. Paired Associates Learning 


Dear et al (65-304) compared < laarning-cptimization procedure 
derived from a stimulus-sampling mocel and another simple presenta- 
tion strategy in training subjectsinseveral paived-associates tasks. 
The "optimal" strategy was fouad to be no becter than the second pro- 
cedure. it appeared some reoresentation of snort-term memory must 
be incorporated in the model. Tae experimenis were conducted in tne 

CLASS system. 
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Izawa and Estes (65-302) found that fie learning of paired- 
associate items was aifected to 2 ae extent by the ratio of rein- 
forced (R) to test (T) trials and by taelr arrangement in various 
repetitive secuences. For example, cverali the sequence RTRT...: 
anpears more nearly optimal than AR RVRRT.... A stimulus-fluctuation 
model provides a somewhat better account of the acquisition and re- 
tention phenomena than a one-clarmenat mocei. 


Fonkl 


Giaser, 1 ea Aoma (64-1 10 1) ee leaenites sets were formed by all 

fear ners using programmed instructica, -egard.ess of individuai 

differences. PSI research at the University of Illinois Training 

Research Laboratory includes an effort to estab.isn whether a learn- 

ing pattern in DROE Tare instruction is one of proactive inhibition 
¢< learning seit (64-602). 


Os 


3. inspection Behavior 


Rothkopi (63-103) prososes a model for leazring from self- 
instruction programs consisting chiefly of written sentences. The 
model suggests that inspection behavicr plays a critical role in the 
effectiveness of seif-instruction programs. 


4. Comrvuter Simulation of Human Learning and Problem-Solvirg . 


Human learning and problem-solving orocesses have been studied 
by computer simulation (64-505). Evens (64-1103) has devised a com- 
puter program (in LISP) which solves by heuristic methods a wide 

ariety of intelligence test problems cf the geometric analogy type, 
viz: "Figure A is to Figure B as Figure:C is to which of the following ?" 


B. INSTRUCTIONAL LOGICS © 


Conversational interaction as simulated on she computer can be 
classified in two major categories: tutorial end Socratic. In the 
tutorial model, information is asserted to the student and he is required 
to respond toa question. There are tnirae kinds of tutorial programs: 
linear, intrinsic, and adactive. Foellowiaz Skinner, in a linear vro- 
gram the pace of instruction is changed -c fit the student, <ad stimuli 
to Which the student responds inacorvectzy muy se repeated. Otner- 
wise the linear program treats ali studems alike. 
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aera w.ace up of a sequence of mu.tiple 


S$S$ertion is oased on che student's 
: "4 nus, by orencning, sach student 


sasTonse to ine 
my 


dume subject-matter. The pro- 


4, 


may take a cifferent path carcugs ire 
gram is asaptive in pace and in tne araount of instruction each student 


receives. 


QUO ony fics A@scuncion is based on an ex- 


ree 


istory Of student responses tt the program. Svoiurow (65-702, 
4-662) advocates an ainptive system in which cacn stim lus 
igs based,nct only on the evudent's resvonses to the program, out oa nis 


utoria. characteristics of asliivde and pevscnality. me cails tais 


Be 
an ideomozrshic system and acs iilustv<ted in operational verms (64-901) 
the way in which different caarectevistics of .earners are used in ideo- 


morphic programming (imp.em noted ca & two-stage decision process). 


the tutorial vaccel. The second major interaction 
sibed as Feurzeig eta: (65-i001, 


tutorial programs = allowing the svuctent to raake awen ons or ask 
questions of the computer. ‘ne comptier bases its response toa 
question ov asservion on its history o. che interaction to that point. 


In the Socratic system the siudeni is to (i) deduce reiationshins 
among elements of a solution, i.e. form concepis; (2) ask questicas 
and make assertions and always odvaia a meaningful response; and 
(3) use natural language. The comouter control language should 
(4) employ conditional expressions taking into consideration the 
nistory of the learner's actions, and (5) the compiler should be easy 
for the teacher to use (65-302). The Socratic system is also, there- 
fore, adactive. 


iviost of the systems described in ‘this resort fit into one of the 
foregoing categories, alihough scne may overlap ancther. The basic 
logic in PLATO II is tutorial and intrinsic, bat the student can control 
the presentation with special function keys inciuding "reverse" which 
permits review of slides, “heip,"' and "aha'! which permits termina- 
tion of a "nelp'' sequence (62-46:). 
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LATO iis a tu out progvam like PLATO O, but it orovides | 
uy to eight heip or error correction sequences instead of one. . 
can also be inserted. These comoere student oerform- 

ecified criteria anc sranch to:additicna: expository 


materials until the criteria ave rnec. Wha pregyverais thus made more 
adaptive (6 L707 . Ina PLATO UA incviry Prain.xng Program a motica 


picture is fires saown using auxiilasy equizmen... Tnen PLATO pre- 
sents questions. The stucert me-y ivy -o answer. or reques: additional 
information (64-401). 

COURSEWRITER is also tutcrial ané intrinsic (64-002). An early 
realization of an adaptive logic in a teaching machine was broughi off 


by Pesk in SAXI (65-103). 


cS. SIMULATION 


Not cll CALis #8 Girective 25 = tutoriil »rogram, or evenas the 
Cooratic system. in some apolications the compacer creates a simu- 


d environment and vrovides an Dopo srenicy for tae stucent to inter- 
act with that environment, .earnins by trizi and orror. 


For example, the computer may simulate a izboratory in which the 
student is able to initiate the same operations he would ina real labora- 
tory. SDC has created a simulatec laboratory fcr statistics (65-402, 
64-002). The MIT Dept. of Civil Engineering has developed structures 
and stress problems which undergraduate and graduate stucents solve 
on the computer (64-501). In the MIT apod-ications, the computer not 
only creates tne simulated environment,: but is used as a tool in the 
solution of the problem, in much tre same way it will be used to solve 
a real engineering problem. 


IBM and the Board of Cocperative Educationa. Services (BOCES) 
in Northern Westchester County have ceveioped a unuiaeed environ- 
mnent for teaching economics to eiemerniary schoo! students (65-201, 
54-1202). The vurvose of this simulation is to develop in the student 
(i) an understanding of the processes at work in a developing civiliza- 
tion, and (Z} tae ability to make Cecisions: regarcing multifactored 
situations, taking account cf severai conilicting values or goals. The 
student assumes the role of a priesi-king:of a Sumerian city-state in 
ehh B.C. Through a remote tyoewriter termina:, the computer 

(2BMé 7090} gives him ane cor.ditiong anc asks for decisions (e.¢. 
Sow much of this year's grain harvest skculd be set aside for next 
ees cianting 7). BOCES has a secord gu-muiation, the Sierre Leone 
Development Game, in deveicoment (65-263). 
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ri 


The Socratic Systera also creates a Siraiiated environment 
-1001, 64-804, 64-601). Yor example, fo: instruction in mectical 
gnosis, a icdea petliest oc. aosivi facilities are simulated. 
g woisa, i. ucingssis simulated. Unlike the 
wis) SeOnoraiLe games, the pocratic 
tira io «: v.efouraance in ine feedpack, 


EL the Me magement cxeve 


triel-andc-crroy Conrec ee. ti eae instruction. This 


S 
3 available in the weal enviroment waen an insevuctor is 


is Daeionesy, Cho preeras may be arranges one continuya 


enainy irom tae cighiy Cirective prograras, suca as COURSE-~ 


oll mre Baten Seart oe 


Sen. ato ee) EO be Mead. See ave at the ones, suchas tae 


ivi. engineering problems. ‘The Socrasic System, the Sumerian 


O. 


ame, and SININ lie somewnsere in between these two extremes. 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001300060035-6 


os 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001300060035-6 
Vo 2 RCGORANIMING 


A. SEQUENCE VARIABLES 


In structuring a proyram, ever a linear prograri, sequence 


4 
varie bles fall into at least inres cl.sucs re azteca to (1) tre nature af 
(2) ins “eivre of ths ceupiass, and (3) the presernce.or 


tne content, (2; 
reinforcement. ‘“Jne DEUS carvagier imast first Cecide in 
sz to wresent subcorcests -o be 1eariec. When oe must ae- 
ther these will be present das yules, examples, or both. 


* 


e £ 
+ deterrmine the secuir ‘2 of veis.forced and non- 
s on of reinforced items 


Fi 0s oe 
-1)33) have discriminated 


3, including tae vep 
as veview frames. Hickey anc Newtcr (c 
between tnese variaoles in a stucy of tue structure cf the knowledge 
svace and the relationshiv between a muiti-d.raensional knowledge 


soace ana the one-dimersional vea chiaz sequsnce. 


“ 


cies of cecuence variables, some invest- 


in experimental stua 
ivators have found diiferences in pede efiectiveness, others have 
mot. Stolurow and his colieazues (94-70:i) foanc no difference in 
learning effectiveness as a resu.t of acior experience wth three 
cifferent components of a subsecuent.y 1ezrn2d mathematics cask. 
Nor did the order in whicn items aopaared in a program seem to make 
a difference in learning when on2 sequence is considered orderly and 
the other random. Newton and Hickey (64-1iG2) report some effects, 
mowever. Using 12 versions of a 59-fsame program teaching a concept 
ja sconomics, they varied tne order and position of subconcepts and 
the Girection of the prograra with respect to definitions. The sequence 
variables cid not affect error rate, but scme did affect time to com- 
‘slete the program and achievement. 


Sievidan and Mayer (05-305, 63-1262) and Bio-Dynamics, inc., 
5-403) describe a phylogenic strategy for sequencing the content cfa 
oe that teacnes the function anc structure ofa system. Fo .low- 
ing the phylogenic sequence, tne trainee benz.ves as an invenior, 
causing tne subject system to proceed in its development through the 
various stages, or "phyla, ‘'in its evo.ution, either hypothetical or 


real. 
Cortent sequence was investiveced by Dear et al (55-504) in 
TRICO EULCclaves learning exreevirrerisg., One optimization theory for 


ata ne ae +S ions to Agi ousye en a a a i 
GeIOm OL STIMULUS 1Ui 24S Wee oasec ona StIN..US -csamp.ing 


mocel cia learning experiment. Foowever, inis strategy was not 
round suverior te another sirap.e oressniation strategy wien tne two 
é corms .ared experimenialiv. it axseared soume representatior. of 
short-term memory must be incorsoratec in tae model. 
neared For Release 2003/04/29 : CIA-RDP84-00780R001300060035-6 
23 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001300060035-6 


; to irs.ditiora: concepts of learniag 
teryine Whether an undesirable 
erara was one of proactive innibition 


Pr eo) 
ce We: ae 


pregram is of no ee. it; put the. eae e remew is cohen als 


‘wo of the orincinal elements in srograxrmed instructica 

r mes, ard non-reinforced or 

Lec the optimal sequenc- 
: :q aeece ence The course of 

by se fae ; ead py theix arrange- 
maent in repeiitive secuences. Overa.i the secuence KYRT... appears 

“Go be most nearly ovtimal. Yhey coaciuce that a stimulus-fluctuation 

mocel gives a better account of accuisition and retention cnenomena 


than a one-clerncnt mocei. 
Hershberger (65-265) comvared taree intervals of delay be- 

vween the initial stimulus presentation ird subseque es testing. in the 

Ss reread pee Stimulus item be: Or 


Tnere was an effect on errors in 


s ed after S responded. 
the orogram, hat mot on achievement. ir any case, however, self- 
testing was suverior to no seli-testin:. 


5S. DECISION STRUCTURE 
a. anctructionai Aiternatives 


meena programs give a.l stucenis the same instructional met- 
ovlai. Po accommodate iadivicual di: aCe intrinsic, prancninge 
Or adaptive programs may make zvai.able alternative meterials, 
ozsing the selection of material on the S eeaea oe most recent response 
ox ona more extensive response history. For example, to instruct 
formacion retrieval. svstem in the cuery 


- Cuaee Ba. (o4-1203) used a computer- 


followed a viodifiel "ranin trunk" branchin 
“raain trunsx' was the linear -urcgra:r including pretest,’ 


Sec. eNce, end wOstcegt. 
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ference between alternative stimulus materials majy 
of cusing cr grorapiiig, the amcunt of ins 


s {step size), Tepes tion oi segular frames, and 
special remeciai frames. Cliser and nis agsocia.es 
(44-7502) did not demonstrat: an increase in Learning etficiericy for 
straigu. iaear pregram. ress and 

oC tie aracint Of. prompting ina program 
onse foe tne amount of prompting 
on ca into groups homo- 


vireraents. Stciurow et al 
s tivy.e on a large-step pro- 


programs im verras Of acaievemen:. : 


a 


aveileble co tie ¢tudent ia an intrinsic program. 
> flada significant difference among the three amounts wita 
~esnecs to time to comviete the progre.m or achievement. 


. Decision Logic 

Stzingic Bac acaptive progvams base the seieciion of alter- 
native meterial on the student's most:recerns response, or ona more 
extensive response history. Severai iogics .or the selection of mat- 
erials at each step ina pr 
assisted study of speed reading, ee (64-594) based the cnoice of 
instructional material on a statisticas evaivation of the student's, cotal 
va) or in comparison with other stucents! total behaviors, the: 


Vi 
stat istic changing as new students took the course. ; 


Snauford (65-501) and Baker (66-501) rave described a decision 
structure by which the computer cona.ders Loth the stucent's answers 
sa his Cegree of certainty wnen praacning to remedial sequences or 
farther steps. A special scoring system has been deveiopead for this 

ourpose. No "errors are raade by the. student. He progresses 
through | levels of certainty and the computer always acts in tne 
cirection of raising his certainty. 


Cc. FRAME CONSTRUCTION 


darmine the effect of formal, 
aysear in programmed agatha mi 


ot 
: incomuistent wivn the S iersc 
“Gezements caat were 1 acorrect, ‘put 


wey a ne ee ae 


er were more deliberate. A moddvate level of incompatioility. 


wc sulApbraved Eor Ralease 2003/94/2%; GA:RDP84-00780R001300060035-6 


ed texts, Kauimen (es- i0Z) varied the arpount | 


Tam Aave deen proposed. in a computer--: 
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SiGe vow ena nies Clales (O4-70 2.) reoost no consistent 2 
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fs 


rimirnze* umstruction materiai 


SQver, tagy cid find it more: 


fescvll Sc @ uGiiccutua. moaei for Learning - 


VOWS Vos SOnks So enies ¥ of writen sen- 


t 
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temporai neon raguinimourtant asecciation- + 
28 bane inscection aes or plays 


corinciple. The model prc 


& CFITiCaL TOLG in Cevernral Seit- -instruction 4 
su, FE TS Ss 

oe ME wh tae 

mos el on Sof ete 8 oe mt 

aw ao ee Ra Ne Ve NTS wee INS ZTLOIN 


for & paysician and computer rrogrammesy to prepare the medical case 


c 
uged to cemonustrate the azplication of the Socravic System to instru¢tion 
in medicai diagnosis. An additional 30 Zturs ef computer programming 


wad clerical transposition were needec, s.us several nours for editirg 
: is! he student's vocebilary consists of 40 questions 
€ 


i609) believes one nour of instruction per week, or: 


isa 

d ieee ruction maetezials. He concludes that, unless 

is automated, it williciten be necessary to resort 
s 


y 
ci 
1) 
ro) 
fon 


Onveéi Stionsi Whe 


cho 
1@] 
Q 


fa 
cacure he nas folicwea for gradually autamating instruction which he 
osiieves can save supstantial amounts of srogrammming effort. 


w describes the use cf SOU:.A TES to develon a technoiogy 
gw mazverials (20-754). Tae procecurs is based on 
SCYUCTLOR ITOMISS WALLER a.loav 


elevant ior nis 


° fod 7 - 
story or fvan.as, Wich iremus are 
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reiated this question to 
larg? number of hy votheses.. 
i. Wide variakions 
observed in terms of . 
subse on Gt Eaeceptabie 


Bw daxge as practical, 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001300060035-6 


Approved For Release 2003/04/29 : CIA-RDP84-00780R001300060035-6 


VI. EVALUATION 


The ultimate criterion for automated instruction is student 
achievement per unit time and cost, but there are many intermediate 
or related criteria, such as error rate, reaction time, data rate 
requirement placed on the system, student reaction, etc. Eight per- 


formance criteria are discussed in connection with the evaluation of 
PLATO II (62-702). 


Several investigators have compared the learning effective- 
ness of CAI and more conventional instruction. At the University of 
Illinois, nine students in an introductory course in digital computers 
took three lessons via PLATOII. Their examination grades parel- 
leled those of the rest of the class and they were enthusiastic about 
CAI (62-702). 


Grubb and Selfridge (64-302) have described a typical experi- 
mental design used to compare CAI performance with instruction via 
programmed text or lecture. The three performance criteria were 
mean instruction time, mean review time, and average achievement 
score. The course was the first half of a one-semester course in 
psychological statistics. Students under CAI covered the material in 
5.3 hrs. compared with 49 hrs. for the lecture mode and 12.2 hrs. 
for the programmed téxt. The average achievement score in the CAI 
mode was 94.3 compared with 58.4 in the lecture mode. 


Student reactions to CAI were reported by Wodtke and his 
associates (65-902) who found that some students, especially low 
achievers, considered the CAI presentation on a remote terminal of 
the IBM Yorktown system too rapid. They suggest student-controlled 
pauses. 
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VII. ADMINISTRATION 


Based on PLATO system experience, Stolurow (64-402) 
believes CAI may be made available for as little as 10 cents per 
student hour. 


Grubb (65-906) points to the economic advantage of assign- 
ing two students instead of one to each CAl terminal. He investigated 
the pairing of students in a CAI course in statistics. His results 
indicate that students paired on the basis of their College Entrance 
Examination Board verbal scores will do as well on the final examin- 
ation as students who study individually at the CAI terminals. 
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APPENDIX A 


CAI Subject Matter 


Subject 


Mathematics and Statistics 
Algebra, UICSM 
Arithmetic, binary 
Mathematics: Algebraic proof 


Number squaring and cubing 

Statistics 

Statistics, inferential 
History 

History, American 
Languages 

English 

Logic: Syllogisms 

Spanish 
Science 

Medical diagnosis 

Physics: Bi-metal strip expt. 

Science, elementary 
Economics 

Economics | 
Business and Accounting 


Accounting 


Engineering 
Structures 


222/F897 
101/R234 
424/C778D 
424/C778C 
730/M266 
730/M266 
730/G885 
644/G885 
022/F948 


116/C324 


730/M266 


730/M266 
400/F841 
116/C324 


435/F426 
434/S975 - 
433/F426 
424/C778D 
424/C778C 
444/W769 


448/M739 
424/C778 


430/F426 


746/M414 


Serial No. 


64-204 
59-001 
64-1001 
64-702 
65-910 
65-910 
65-906 
64-302 
64-002 
65-402 


65-910 


65-910 
65-908 
65-402 


64-601 
65-1001 
64-804 
64-1001 
64-702 
65-202 


65-201 
64-1202 


64-503 


64-301 
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Subject 


Computer Technology 
Computer approaches to 
engineering problems 
Computer programming (473L) 
Computer use 
Computers, digital 


Games 
Bridge 
Roulette 
Tic-Tac-Roe 


Reading and Spelling 
Reading 


Spelling 


Skills 
Keyboard operation 
Metal surfaces, smoothness of 
Nonverbal sounds 
Nursing, clinical methods in 
Task logic 
Typing 


Call No. 


746/M414 
644/C589 
644/M468 
424/C778A 


730/M266 
731/B512 
731/B512 


730/M266 
640/P651 
411/S919 

730/M266 


620/E97 
420/M191 
328/S975 


424/C778B_ 


118/S552 
640/P651 


64-301 
64-1203 
65-801 
62-702 


65-910 
65-904 
65-904 


65-910 
65-502 
64-504 
65-910 


65-103 
63-901 
62-601 
64-401 
63-1202 
65-502 
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APPENDIX B 


INSTITUTIONS WITH CAI 
Institution 


Stanford Univ. (Stan.) 

System Development Corp. (SDC) 

Carnegie Inst. of Technology 

Electronic Systems Div., Air Force (ESD) 

Bolt, Beranek and Newman (BBN) 

Univ. of Illinois, Training Research Lab (TRL) 

Univ. of Illinois, Coordinated Science Lab (CSL) 

Mass. Inst. of Tech., Civil Eng'g. Dept. (MIT/CE) 

Mass. Inst. of Tech., Operations Rsch. Grp. (MIT/OR) 

Mass. Inst. of Tech., Project MAC (MIT/MAC) 

Mass. Inst. of Tech., (MIT/ESL) 

IBM Watson Rsch. Lab. (IBM/ York.) 

IBM Poughkeepsie 

IBM Advanced Systems Div. (IBM/Los Gatos) 

Univ. of Pittsburgh, Learning Research and 
Development Center (Pitts/LRDC) 

United Air Lines (UAL) 

Brooks Foundation 

Bell Tel. Labs (BTL) _ 

Penn. State Univ. (PSU) 

Florida State Univ. (FSU) 

Harvard Univ. Computation Center (Harv.) 

Univ. Calif., Santa Barbara (UCSB) 

Univ. Calif., Los Angeles (UCLA) 

Univ. Calif., Irvine (UCI) 

Univ. of Omaha (UO) 

McGraw-Edison 

Board of Coop. Educational Services (BOCES) of 
North Westchester County 


System 


Stanford I & II 
CLASS 


COBIS 

Socratic System . 
SOCRATES 
PLATO 

MAC 


IBM Yorktown 
IBM Poughkeepsie 


Instamatic 


IBM Yorktown 
IBM Yorktown 
TACT 


ERE 
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APPENDIX CG 


CENTRAL COMPUTERS 


GE-235 & D-30. Central equipment in the Dartmouth system. 


The D-30 is the master computer and schedules all nontrivial 
operations in the 235. The D-30 can communicate with the 

235 or the dual access file and handles 1/O from and to the 
teletypes, allocates and releases disc space and analyzes and 
responds to user commands. The 235 is used for editing, com- 
pilation, program runs, and large block transfers from one 
area of the disc to another. Incoming problems share the 235 
in short bursts of time on a rotating basis (65-903). 


IBM 1440. Central computer in the IBM system at the IBM 


Watson Labs, Yorktown, N.Y. Also connected to Penn State 


Univ., Florida State Univ. (65-902, 65-803, 64-001). 
Central computer in the IBM time-shared system at Pough- 
keepsie, N.Y., with student stations in Philadelphia, Los 
Angeles, San Francisco, and Washington, D. C. (65-803). 


IBM 7094. Two 94's located in the Computation Center and 


Project MAC at MIT are connected to typewriters in Rm 1-150 


the Civil Engineering Dept. (64-301). 


IBM 1620. Rm 1-150 in the MIT Civil Engineering Dept. con- 
tains an IBM 1620 (360,000 bit memory plus 32,000,000 bit 
disc pack) (63-301). SOCRATES has been developed ona 1620 
with 2 million digit RAMAC disc memory at the Univ. of Illinois 
Training Research Lab. (64-602). 


IBM 650. Before changing over to the present 1410-1440, the 
IBM Yorktown system was based on an IBM 650 RAMAC with 
disc file for 6 million digits and 0.8 max. access time (64-302, 
59-001). 


IBM 1401 or 1410. The Air Force Electronic Systems Division 


used the System 473L computer (IBM 1401 or 1410) to teach 


console operators the query language used by the operators to 
retrieve information from the 473L system (64-1203). 
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ll. 


12. 


13. 


IBM 7090. The Board of Coop. Educational Services 
(BOCES) of Northern Westchester County used an 
IBM 7090 time-sharing system to present computer- 


based economics games to sixth-grade, students 
(65-203, 65-202). 


DEC PDP-1. Central computer in the BBN Socratic 
System at Bolt Beranek and Newman (64-601, 62-601) 
and in the Stanford Univ. system (65-001). 


CDC 1604. The central computer for PLATO III (64-1202, 


64-1001, 64-401). 


ILLIAC. The central computer for PLATOI and Il. 
(64-1202, 62-401). 


Bendix G-20. Installed in Carnegie Institute of Tech- 
nology Computation Center for use as a teaching machine 
for students in mastering certain drill problems in math., 
engineering, and physical sciences (61-701). 


UMShN. Central computer in the Radon complex at the 
Academy of Sciences of the Ukraine (64-201). 


Ural-1. Central computer at the Kiev Higher Radio- 
technical Engineering School (64-201). 
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